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COMPLEXITY  AND  COMPUTABILITY  OF  SOLUTIONS  TO 


LINEAR  PROGRAMMING  SYSTEMS 

by 

A.  Charnes,*  W.W.  Cooper,** 

S,  Duffuaa,*  M.  Kress* 

Abstract 

Complexity,  computability  and  solution  of  linear  programming 
systems  are  re-examined  in  the  light  of  Khachian's  new  notion  of 
(approximate)  solution.  Algorithms,  basic  theorems  and  alternate  re¬ 
presentations  are  reviewed.  It  is  shown  that  the  Klee-Minty  example 
has  never  been  exponential  for  (exact)  adjacent  extreme  point  algorithms 
and  that  the  Balinski-Gomory  (exact)  algorithm  is  polynomial  where 
(approximate)  ellipsoidal  "centered-cut-off"  algorithms  (Levin,  Shor, 
Khachian,  Gacs-Lovasz)  are  exponential.  Both  the  Klee-Minty  and  the 
new  J.  Clausen  example  are  shown  to  be  trivial  (explicitly  solvable) 
interval  programming  problems.  A  new  notion  of  computable  (approximate) 
solution  is  proposed  together  with  an  a  priori  regularization  for  linear 
programming  systems.  New  polyhedral  "constraint  contraction"  algorithms 
are  proposed  for  approximate  solution  and  the  relevance  of  interval  pro¬ 
gramming  for  good  starts  or  exact  solution  is  brought  forth. 


INTRODUCTION 


The  interest  aroused  by  L.S.  Khachian's  announcement  in  the 
Soviet  Doklady  of  "A  Polynomial  Algorithm  for  Linear  Programming"  and 
the  misrepresentations  (particularly  by  journalists)  of  Khachian's 
results,  have  induced  the  following  re-examination  of  "informational 
complexity"  and  its  relationship  to  computability  and  solution  of  linear 
programming  systems.  Contrary  to  journalistic  pronouncements,  Khachian's 
result  is  an  existence  theorem  for  determining  consistency  or  inconsistency 
of  a  system  of  linear  inequalities  of  a  prescribed  form.  The  algorithm 
and  proof  of  its  geometric  convergence  is  due  to  Levin  sixteen  years 
earlier.  Thus,  Khachian's  new  contribution  is  an  existence-theorem-backed 
notion  of  "approximate"  solution. 

As  is  made  clear  in  the  following  section  on  linear  programming's 
basic  theorems  and  alternate  representations,  both  complexity  theory  and 
computational  effectiveness  are  vitally  affected  by  the  different 
geometries  of  "equivalent"  linear  programming  systems.  The 
classic  Klee-Minty  example  for  expanentiality  of  the  simplex 
method  (in  their  paper,  "How  Good  is  the  Simplex  Method?"  [16]),  is 
generalized  and  re-examined.  It  is  shown  that  the  dual  constraint  set  for 
the  generalization  contains  a  single  extreme  point  (which  can  be  computed 
in  n  pivots  from  an  artificial  start)  and,  therefore,  has  never  been 
exponential  for  "exact"  solution  by  adjacent  extreme  point  algorithms. 

The  classic  Balinski -Gomory  [2]  polynomial  bound  algorithm  for 
distribution  (or  so-called  "transportation")  models  is  shown  to  be  polynomial 
where  approximate  solution  by  the  ellipsoidal  "centered-cut-off"  algorithms 
of  Levin,  Shor,  Khachian  and  Gacs-Lovasz  is  exponential.  A  new  example 

We  wish  to  thank  Drs.  L.  Seiford,  J.  Godfrey  and  A.  Schinnar  for 
supplying  us  with  copies  of  the  Russian  and  Gacs-Lovasz  works  herein  cited. 


by  J.  Clausen  for  simplex  method  exponentiality  without  the  Klee-Minty 
dual  side  defect  is  examined.  Both  it  and  a  generalized  K-M  example 
are  shown  to  be  instantly  soluble  as  cases  falling  under  Ben-Israel  and 
Charnes'  explicit  solution  of  full  row  rank  interval  programming  problems  [3]. 

With  these  examples  of  complexity  and  solution  in  mind,  attention 
is  turned  to  computability  of  solutions.  A  new  notion  of  a  computable 
(approximate)  solution  is  proposed,  together  with  an  a  priori  regularization 
for  linear  programming  systems.  To  overcome  the  cumbersome  storage  and 
updating  disadvantages  of  the  ellipsoidal  algorithms  as  well  as  to  provide 
an  empirically  more  rapid  method,  two  new  classes  of  polyhedral  "constraint- 
contraction"  algorithms  are  proposed  for  approximate  solution.  For  exact 
solution  of  problems  with  exponential  numbers  of  extreme  points,  it  is 
suggested  that  interval  programming  methods  such  as  the  Ben-Israel  and 
Charnes  solution  for  a  good  start  and  the  "knapsack-pivot"  algorithm  of 
Charnes,  Granot  and  Phillips  [7]  for  completion  of  solution  have  been  over¬ 
looked  and  merit  serious  computational  study. 

1.  BASIC  REPRESENTATIONS  AND  THEOREMS  IN 
LINEAR  PROGRAMMING 

Solution  of  a  linear  programming  problem  implies  securing  both  an 
optimal  member  of  the  primal  constraint  set  ("optimal  solution")  and  an 
optimal  member  of  the  dual  problem  constraint  set.  The  purposes  of 
analysis  by  a  linear  programming  model  are  served  only  when,  with  a 
desired  primal,  the  dual  evaluators  (optimal  dual  solution)  are  provided. 

Since  all  the  major  exact  (extreme  point)  algorithm  computer  codes  deliver 
an  optimal  dual  pair,  either  of  the  dual  problems  may  be  chosen  for"primal" 
computation.  Experience  has  shown  that  there  may  be  tremendous 
differences  between  the  sDeed  of  computation  from  primal  and  dual 
problem  sides. 


When  we  speak  of  a  "linear  programming  system,"  we  refer  to 


a  system  involving  both  primal  and  dual  problems. 

Re  notation,  we  employ  capital  letters  to  denote  matrices,  lower 
case  letters  to  denote  column  vectors  (except  that  a  capital  letter  with  a 
subscript,  e.g,  PQ,  may  also  denote  a  column  vector).  By  is  meant  the 
j  n  column  of  A  and  ^A  is  the  1  n  row  of  A.  c  is  the  transpose  of  the 
column  vector  c. 

The  major  representations  or  formats  for  linear  programming 
systems  we  shall  designate  as  "Tucker's  form"  (T),  the  "equalities  form" 
(E),  and  the  interval  programming  form  (I)  as  follows: 
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Note  that  the  latter  LP  can  be  written  equivalently  as 


-  mt  (- 'P '-) ;  “T  (4^) 


T.  T 
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where 


|u|T  =  (... ,  |u.| ,...) 
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Next,  let  X  =  {x  :  Ax  <  b,  x  >  0}  ,  W={w:  wTA  >cT,  w  >  0}  , 

•A-i  {X:  P  X  =  Pq  ,  X  >  0  }  ,  U  =  {  u  :  uTP  >  cT  } 

We  shall  require  the  following  theorems. 

LIEP  Theorem  (Charnes  1950):  \  #  0  is  an  extreme  point  of  A. 

iff 

{  Pj  :  Xj  >  0}  is  linearly  independent. 


Duality  States  Theorem  (Charnes  &  Cooper  1951) :  There  are  four 
mutually  exclusive  and  collectively  exhaustive  (MECE)  duality  states  for  (T): 


(1)  X  =  0,  W  =  0 

(2)  X  =  0,  inf  wTb  = 

W 

T 

(3)  sup  c  x  =  «°  ,  W  =  0 

X 

3T  T1  '■p  T 

x*  e  X  ,  w*  e  W  3  max  c  x  =  c  x*  =  w*  b  =  min  w  b 

X  W 

with  x*.  w*  extreme  points. 

This  theorem  is  valid,  of  course,  for  the  other  two  linear  programming 
forms  on  replacing  X  and  W  by  the  corresponding  primal  and  dual 
constraint  sets,  e.g.,  byAand  U  for  the  "equalities"  (E)  format. 


Equivalent  Inequality  System:  (£*,  n*)  is  a  pair  of  optimal  solutions  to 
the  dual  problems  in  (T)  iff  it  is  a  solution  to  the  linear  inequality  system: 

T  T 
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If  (I)  has  a  finite  optimum  and  A  is  of  full  row  rank, 


then  the  set  of  all  optimal  solutions  of  (I)  is  given  by: 


x*  =  A#  z*  ,  A#  a  right  inverse  of  A 


where 


,  if  (cTA#).  >  0 


z*5  =  <  b 


i  ,  if  (cTA#).  < 


9.  b*  +  (1-  0.)  b.  ,  V  0S6.<1,  if  (cTA#)i  =  0 


That  "equivalent"  linear  programming  problems  may  have 
substantially  different  constraint  geometries  may  be  seen  in  the  following 
favorite  example  of  K.  Kortanek's.  The  primal  problem  (1.1)  is  a  simple 
2-node  directed  network  problem.  Its  constraint  set, A  ,  has  one 
extreme  point.  An  equivalent  dual  problem  (1.2)  is  of  interval  programming 
form.  Its  constraint  set  U  is  an  infinite  strip  in  2-dimensions,  i.e.,  has 
zero  extreme  points.  Putting  it  back  into  equivalent  (E)  form,  (1.3), 
its  new  constraint  set  has  five  extreme  points. 
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The  non-equivalence  geometrically  of  different  equivalent 

representations  of  dual  constraint  sets  was  first  pointed  out  and 

studied  by  Charnes,  Cooper  and  Thompson  in  [11].  Currently, 

U.  Eckhardt's  work  has  yielded  the  most  significant  results.  It  and 

references  to  the  other  major  work  are  to  be  found  in  [12]. 

2.  KHACHIAN'S  SOLUTION  AND  LEVIN’S  ELLIPSOIDAL 
BISECTION  METHOD 

Consider  the  system  of  m  >  2  linear  inequalities  in  n  >  2  real 
variables 

n 

(2.1)  2  ait  x  <  b.  ,  i=l . m 

j=l  A  J  1 

or,  compactly, 

(2.2)  aT.  x  <  bj 

When  the  a.^  and  b.  are  integers ,  the  number  of  binary  digits  required 
to  store  this  data  is 

!m  n  m 

2  £  log,  C  la..  1  +  1)  +  S  log,  (|  b. |  +  1)  +  log  (mn) 

i=l  j=i  1  U  i=l  2  1  2 

We  shall  call  the  convex  non-differentiable  function 

T 

(2.4)  9(x)  =  max  9  ^(x)  ,  where  0  j(x)  e  a  .  x  -  b,  , 


~i  • 


the  "residual"  at  the  point  x  of  the  system  (2.1).  Note  that  6(x)  S  0 
for  some  x  iff  the  system  is  consistent.  Alternately,  x  is  a  member  of 
the  constraint  set  iff  it  is  a  zero  of  the  convex  function 
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(2.5)  8(x)  =  max  [0,  0(x)] 

Thereby,  finding  a  solution  to  the  system  (2.1)  is  equivalent  to  the 
convex  programming  problem  of  minimizing  0(x)  as  well  as  to  finding  a 
zero  of  9(x) . 

N.Z.  Shor  of  The  Institute  of  Cybernetics  of  The  Ukrainian 
Academy  of  Sciences,  whose  published  research  on  algorithms  for  such 
problems,  for  instance,  [19],  [20],  [21],  [22],  [23],  extends  continuously  from 
earlier  than  1968  to  the  present,  is  cited  in  Khachian's  1979  Doklady 
announcement  [15]  only  for  Shor's  1970  paper  as  the  source  of  Khachian’s 
idea  for  an  algorithm.  However,  Shor's  1977  paper  plainly  states  that  the 
idea  of  and  first  proof  of  geometric  convergence  of  a  class  of  algorithms 
which  includes  Khachian's  is  due  to  A.Y.  Levin  in  the  1965  Doklady  volume  [17]. 

Levin's  idea  is  to  start  with  the  center  of  an  ellipsoid  which 
contains  at  least  one  solution  to  ( 2 .1)  if  consistent .  If  this  center  is  not 
a  solution,  the  ellipsoid  is  bisected  by  the  most  violated  hyperplane  and 
the  half-ellipsoid  which  contains  a  solution  is  enveloped  by  a  new  ellipsoid 
of  minimal  volume.  The  center  of  this  new  ellipsoid  is  taken  as  a  new 
start  and  the  process  is  repeated.  This  continues  until  the  volume  of  the 
attained  ellipsoid  is  as  small  as  desired.  Shor  calls  such  algorithms 
"(ellipsoidal)  centered  cut-off"  algorithms. 

Khachian's  existence  theorem  is  implicit  iij  the  following  two 
lemmas  plus  geometric  convergence  of  the  algorithm. 
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Lemma  1:  If  the  system  (2.1)  with  input  L  is  consistent,  then  there 


exists  a  solution  x°  in  the  Euclidean  ball 


S  =  {  x  :  1 1  x  1 1  <  2U}  . 

Lemma  2:  If  the  system  (2.1)  with  input  L  is  inconsistent,  then  for 

_ T 

any  x  e  Rn  the  residual  0  (x)  >  2-2 

2 

In  16  n  L  steps  Khachian's  algorithm  delivers  an  ellipsoid  center  with 

minimum  algorithm  residual  <  2  L  if  the  system  is  consistent.  If  not, 

the  residual  remains  greater  than  2-2  The  final  center  defines  what 

we  call  Khachian's  (new  notion  of)  solution. 

Since  Khachian's  announcement  contained  no  proofs,  Gacs  and 

Lovasz  in  [13]  established  Lemma  1  using  the  LIEP  theorem  and  determinantal 

bounds  in  Cramer's  rule  solutions  of  linear  equations.  They  established 

the  other  properties  but  for  the  following  new  ellipsoidal  algorithm 

2 

which  requires  only  6n  L  steps  and  no  Gram-Schmidt  orthogonalization 
at  each  step. 

Gacs  and  Lovasz  define  a  sequence  x°,  x1,  ....  e  Rn  and  a 

sequence  of  symmetric  positive  definite  matrices  A°,  A1 .  recursively 

as  follows  x°  =  0,  A°  =  2LI.  Suppose  that  (xk,Ak)  is  defined.  If  xk  is 
a  solution  of  (2.1),  stop .  If  not ,  pick  any  inequality  in  (2.1)  which  is 
violated,  say, 

8  i  x  >  bi 


and  set 


(2.6) 


k+1  k  ,  1 

x  =  x  +  Hn 


.k 
A  a. 
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,  k+l 


n2-l 


lc  lr  T 

2  (A  a.) •  (Aa.) 1 
11+1 

8  i  A  aj 
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k  k  T 

Note  that  (A  a.)* (A  a^)  is  a  symmetric  nxn  matrix  as  the  matrix  product 
of  an  nxl  vector  and  its  lxn  transpose.  Gacs  and  Lovasz  note  further 
that  all  computations,  e.g.  square  root,  are  supposed  performed  to  an 
accuracy  of  exp(-lOnL). 

For  linear  programming  the  x  vector  is  the  (£,,  n)  pair  of  dual 
problem  variables  in  the  system  (  T).  We  exhibit  the  simplex  method 
and  Lemke's  Dual  Method  schematically  (Figure  1)  in  (£,n)  space  by  projection 
from  their  (E)  form  variables.  When  consistent,  i.e.,  case  (iv)  of  the 
Duality  States  Theorem,  the  constraint  set  consists  with  probability  one 
of  a  single  point,  i.e.,  the  dual  LP  problems  which  have  a  unique  optimal 
pair  of  solutions  form  an  everywhere  dense  open  set  in  the  space  of 
consistent  data. 


■c\ 


I 

\ 
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3.  COMPLEXITY  OF  A  GENERALIZED  KLEE-MINTY1  EXAMPLE 

We  do  not  accept  the  re -definition  of  complexity  (or  "informational 
complexity"  as  the  Soviets  call  it)  which  Khachian  implicitly  makes  in  [15] 
as  the  function  of  "L"  required  to  bound  the  number  of  iterations  of  an 
algorithm.  Most  inequality  systems  or  linear  programming  problems  are 
and  have  been  given  in  terms  of  coefficients  which  are  not  necessarily 
integers.  Further,  all  the  classic  results  on  complexity,  e.g.,  Klee  and 
Minty  [16]  or  Balinski  and  Gomory  [2  ],  are  given  "in  Jack  Edmond's 
sense"  as  "the  number  of  pivots  or  iterations  required. .  .(as  a) ...  function 
of  the  two  parameters. .. (number  of  equations  plus  inequalities  and  number 
of  variables) ..  .tuat  specify  the  size  of  the  program"  (see  p.  159  of 
Klee  and  Minty).  We  shall  use  Edmond's  sense. 

We  generalize  the  Klee-Minty  example  by  replacing  their  "e"  by 
arbitrary  "c.'s"  where  0<£j<1/2,  all  i.  Their  problem  is  then: 


s.t. 


(3.1) 


E^Xj-X 


e^Xj+x 
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max  x 
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<  0 
<  1 
<  0 
<  1 
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Its  (unstudied)  dual  is: 


1We  wish  to  thank  George  Minty  for  his  friendly  help  in  providing 
a  copy  of  the  published  paper. 


min  w. 
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+  v2+  +w3+ 

+  v+ 
n 

+  £^2"  + 

elw2+ 

-  0 

W2  + 

W2+  +  e2W2‘  +  £2W2+ 

-  0 

(3.2) 


-  +  -  + 
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We  choose  to  analyze  and  solve  this  problem  from  the  dual  side 

with  the  modified  simplex  method  of  Charnes  and  Lemke  ( 1952  [10 1  >  [  5  ] ) . 

Notice  from  the  last  equation  that  every  member  of  the  dual  constraint  set 

must  have  w  +  >  0  (e.g. ,  w  +2:1).  Therefore,  it  must  have  w  .  >  0, 

n  n  n-1 

and  successively  w  w  „,  ...»  w.  >0.  But  the  coefficient  vectors 
n- z  n~ o  l 

of  w1  ,  ...  ,  wn  l>  wn+  form  a  linearly  independent  set  which,  further, 
is  maximal  since  there  are  n  of  them.  By  the  LIEP  Theorem  we  have  an 
extreme  point  and  by  maximality  (in  every  solution)  it  is  the  only  one. 

It  is  the  optimum  solution  to  (3.2)  since  we  are  in  case  (iv)  of  the 
Duality  States  Theorem. 

By  the  theory  of  the  modified  simplex  method  the  optimal  primal 
T  T  -1 

solution  is  x*  =  d  B  ,  where  B  is  the  matrix  of  coefficient  vectors  of 
-  +  T 

w .  ,  . .  ,  w  -  ,  w  and  d  is  the  vector  of  their  coefficients  in  the 
l  n-l  n 

functional.  Here  x  *  =  x  *  =  . . .  =  x  *  =  0,  x*  =  1.  Thus,  we  have 
12  n-1  n 

established 
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Theorem  1:  The  dual  constraint  set  of  the  generalized  Klee-Minty 


problem  is  a  cone  issuing  from  a  single  extreme 
point.  The  optimal  primal  solution  is  available  by 
inverting  the  matrix  of  the  basis  designated  by  this  extreme 
point . 

The  number  of  operations  to  invert  B  and  obtain  x*  is  clearly 

3 

0(n  ).  Thereby,  if  we  are  permitted  knowledge  of  the  dual  extreme 
point ,  we  have  shown  polynomiality  of  the  simplex  method  for  this  example 
class  by  solving  the  dual  problem. 

If  we  are  required  to  be  ignorant  of  it ,  we  next  show  that  in 
n  steps  from  a  standard  artificial  basis ,  we  achieve  this  extreme  point , 
and  automatically,  of  course,  the  corresponding  primal  optimum. 

In  no  way  does  our  result  invalidate  the  soundness  of  the  idea 
behind  Klee  and  Minty's  construction  of  a  tilted,  perturbed  hypercube, 
which,  as  the  intersection  of  2n  half- spaces,  has  2n  extreme  points. 
Thereby,  if  one  must  start  "at  the  bottom,"  an  adjacent  extreme  point 
algorithm  on  the  primal  side  must  take  0(2n)  steps. 

To  get  on  with  our  simplex  computation,  we  consider  the  dual 
"regularized"  problem  ([  4  ],  [  5  ])  in  the  form: 

2  T  T 

min  M  A  +  Me  v  +  c  A 


s.t. 

(3.4) 


P  A  +  E  v  +  P  A  =  P 
o  o  o 


A  ,  v  ,  A  S  0 

Here  the  A.,  j  #  0,  are  the  dual  variables  wk  ,  w^+  of  (3.3), 

T 

c  the  vector  of  functional  coefficients,  P  the  structural  matrix,  PQ  its 
right-hand  side  vector  and  E  the  nx(n-l)  matrix  of  the  first  n-1  unit 


(artificial)  vectors,  M  is  the  "high"  or  non-Archimedean  penalty  "cost." 
Oddly,  here,  PQ  is  the  n**1  unit  vector. 

Starting  with  the  artificial  basis  of  Pq  and  the  n-1  unit  vectors 

2 

of  E,  V^,...,  Vn _j,  whose  functional  coefficients  are  respectively  M  ,  M, 
...,  M,  and  using  the  basis  entry  criterion  of  maximum  "z.-c.",  the  initial 
(abbreviated)  simplex  tableau  is: 


-MotJ  -Met  .  -Met  „  -M  +e  ,M  M  Ma,  |Mol  Mot   Ma  .  M  +e 
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Here  ,  P.+  are  the  respective  column  vectors  of  the  variables  w. ,  w?, 

and  we  only  show  the  column  vector  for  "X  ",  e.g\,  P  in  the  tableau. 

o  o 

_  +  2 

Only  w  ,  w  have  M  in  their  "z.-c.",  and  since 
n  n  ]  3 


(3.5) 


n 

=  Po 

+ 

c  . 
n-1 

Vn-1 

n 

=  -po 

+ 

c  . 
n-1 

Vi 

we  have 

+  + 

.2 

z(w  )  -  c 
n  n 

=  M  +  0(M) 

(3.6) 

0 

z(w~)  -  c 

=  -ivr  +  o(M) 

n  n 

Thus,  P*  enters  the 

basis .  V  , 

n-1 

to  Vn_j  and  Po). 

Since  e  .  V_  =  P  *  -  P  .  P_  =  -2P"!"  P*.  Thus  while  P  ,  P* 
n-  In-  In  on  on  on 

are  in  the  basis 

(3.7)  z(w”)  -  cn  =  -2M2  +  0(M) 

and  P  will  not  be  a  candidate  to  enter, 
n 

2 

Next,  the  only  "M  "  entry  possibilities  are 
+ 


(3.8) 


P'  =e  V  +e~*  P+-c^P 
n-1  en-2  n-2  en-l  n  en-l  o 


Pn-1  en-2  Vn-2  "  En-1  Pn  +  En-1  Po 


Thus,  P  ,  enters  and  V  9  leaves  the  basis. 

11“  X  11“  it 

Thereafter,  while  P-  .  ,  P+,  P  are  in  the  basis 
n-i  n  o 


(3.9) 


P+  ,  =  P  .  +  2  e"1,  P+  -  2  e-1.  P 
n-1  n-1  n-1  n  n-1  o 


z(w*  i>  "  i  =  -2  c"1.  M2  +  0(M) 
n-l  n-l  n-l 


and  P  ,  will  not  enter  the  basis, 
n-l 
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By  induction,  for  1  <  k  s  n-2,  when  P  . . ,P  , ,  P  ,  P 

n-K  n  jl  n  * 


o  are 


in  the  basis,  P  ,  .  enters  and  V  .  leaves.  Further,  P  .  ,  will 
n-K- l  n_K~ l  n-K  x 


not  enter  while  P 


P„  ,  ,  P  ,  P  are  in  the  basis, 
n- 1  n  o 


n-k-1  '*• 

For  k  =  n-2,  V,  is  removed  and  P„  , ...,P  ,,  P+  ,  P  is  the 

x  u  n  x  n  o 

basis.  Now 


(3.10) 


P1  el  P2  (ele2‘*‘en-2)  Pn-1  ”(el*  "en-l)  Pn+(er,J 

P1  =  el  P2  +  "’*  +  (ei‘*'en-l)  Pn-1  +  (£l*,,en-l)  1  Pn  _(el’,,e 


Thus,  P^  enters  and  Pq  leaves.  In  n  pivots  the  unique  optimal  extreme 
point  has  been  attained  together  with  (via  the  modified  simplex  machinery) 
the  optimal  x*  as  the  dual  evaluators  for  this  extreme  point. 

We  have  established 

Theorem  2:  The  generalized  Klee-Minty  problem  is  computable  in  n  steps 
by  the  (modified)  simplex  method  applied  to  the  dual  problem 
from  a  standard  artificial  basis  start. 

Thereby,  the  Klee-Minty  problem  has  never  been  an  example  for 
exponentiality  of  the  simplex  method. 

+  2 n 

As  for  approximate  or  Khachian  solution ,  if  we  take  cn  =  2  , 

L  =  0(2n)  and  the  ellipsoidal  algorithms  are  exponential. 

Our  above  argument  is  still  valid,  however,  since  only  order 

comparisons,  not  exact  values,  are  needed  for  the  "z^-c/’  in  the  simplex 

(or  dual)  algorithms.  Further,  Charnes  and  Cooper  have  shown  explicitly 

in  [  5  ]  how  simplex  or  dual  method  calculations  can  be  made  using  even 

non-Archimedean  "M"'s  by  extending  the  simplex  tableau  by  two  rows 

containing  respectively  the  coefficients  of  M  and  M  and  never  requiring 

2 

numerical  values  for  M  or  M  in  calculation. 


The  classic  result  of  Balinski  and  Gomory  [  2  ]  for  polynomiality 

(in  exact  solution)  of  an  extreme  point  method  for  the  important  class  of 

2 

distribution  models  in  linear  programming,  is  that  via  their  "mutual 
primal-dual  algorithm"  only  (¥■>)(  min  {m,n}^  steps  are  required  to  solve 


(3.11) 


min  £  cij*i] 


Ex..  =  a.  ,  i= 

i]  l 


E  =  bi  • j 


=1 , . . .  ,n 


where  x..  >  0 
i) 

and  the  a.  .b^  are  integers. 

Since,  as  before,  only  order  comparisons  are  needed,  not 

numerical  values,  the  Balinski-Gomory  method  is  polynomial  where  the 

Khachian  approach  is  exponential  in  examples  of  (3.11)  with  some 
on 

c  =  0(2  ).  It  should  be  noted,  however,  that  the  Balinski-Gomory 

algorithm  requires  a  start  with  a  particular  kind  of  primal  and  dual 
variable  choice. 


4.  INTERVAL  PROGRAMMING,  KLEE-MINTY  AND 
J.  CLAUSEN  EXAMPLES 

At  a  recent  meeting  in  Denmark,  Dr.  Jens  Clausen  of  the 
Datalogisk  Institute  presented  a  new  example  for  exponentiality  of  the 
simplex  method  which  we  observe  to  be  free  of  the  dual  side  defect  of 


the  Klee  and  Minty  type.  We  shall  show  that  both  it  and  the  generalized 


We  wish  to  thank  Ralph  Gomory  for  his  friendly  help  in  locating 
their  paper. 
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Klee-Minty  example  are  instantly  soluble  by  the  Ben-Israel  and  Charnes 
theorem  in  interval  programming,  i.e.,  only  one  matrix  inverse  need  be 
computed. 

Consider  first  the  Klee-Minty  type.  It  may  be  written  in  pseudo 
interval  programming  form  as: 

min  x 

n 

0  <  Xj  <1 

zelxl  -  elxl+x2  ~  1 

(4.1)  —  —  —  —  —  —  —  —  —  —  —  — 


2e  ,x  ,  _ 
n-1  n-1  s 


e  .x  .  +  x 
n- 1  n- 1  n 


<  1 


Next  we  replace  the  left-side  vector  by  any  consistent  final  vector  b  , 
e.g.,  b^O,  i=l,...,n,  so  that  we  have  an  interval  programming  problem. 

The  point  of  this  is  that,  referring  to  the  Ben-Israel  and  Charnes 
theorem ,  only  the  signs  of  the  c  Aj  and  not  the  values  of  bj  and  b. 
determine  optimal  solution.  Here 


(4.2)  A  = 

and  we  can  write  A  1  =  En  *  En  2..,E*  where  E^  is  the  elementary  matrix 

which  adds  -e^  times  the  kin  row  of  A  to  the  (k+1)  row  of  A.  From  the 
k  th 

form  of  A,  E  affects  only  the  k  column  of  A. 

T  -1  T 

We  can  now  easily  calculate  c  A  .  Since  c  =  (0,...,0,1), 

cV'1  =  (0,...0,-Gn_1,l) 

(4.3)  cTEn-1En"2  =  (0’,”0,-£n-2’-en-r1) 


cTEn-1 _ E1 


=  ("£1-~e2 . .  en-i’ 
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*  -  +  -1 
Therefore,  z.  =  b.  =0,  i=l,...,n-l,  z*  =b  =1.  From  x*=A  z*  we  get 
ii  n  n 

x%0,  i=l,...,n-l,  x*  =  l,  which  already  satisfies  (4.1).  It  is  optimal 
for  (4.1)  since  b.=0  yields  a  less  restricted  constraint  set  than  in  (4.1). 

Let  us  next  consider  Dr.  Jens  Clausen's  example  which  was 
presented  at  the  Danish-Polish  Operations  Research  Societies  meeting  at 
Rolighed,  Denmark  in  May  1979: 


E  C3J 


(4.4) 


$  5  ,  i— l,...n 


X.  £  0 


where,  dropping  a  factor  of  4~?5,  c.=(4/5)J ,  and  A  =  (a..)  is  a  lower 
triangular  matrix  with  alla..=l  and  a..=2-(5/4)1~;)  for  i>j.  Schematically, 


max  I —  I  x  i  + 


(l)Xl  +  (j)2*2 


4h 


(4.5) 


2  7  h  + 


+  2(!K . + 


■r; + ^ + # 


x_  +  .  .  .  .  2  (-7- )  x  .  +'  x  <  5°  1 

3  \4 /  n-1  n 


with  x, . x  >  0 

1  n 


Since  A  0  and  x  ^  0,  we  can  choose  to  "have"  b.  =  2^  aijXj 

in  an  interval  programming  "envelope."  Thereby  we  would  have  x.*  =  0 
T  -1 

whenever  c  A.  <0.  We  next  ignore  the  x  >  0  conditions  to  consider 
the  less  restricted  interval  programming  problem: 

T 

max  c  x 
(4.6)  _  , 

b  <  Ax  <  b 

where  b  is  implicitly  designated  as  above  and  b^  =  51_\  i  =  l,...,n 

Since  A  is  lower  triangular,  again  E  differs  from  the  identity 

matrix  only  in  the  k*b  column  and  we  can  apply  the  same  product 

k  T  - 1 

construction  as  before  but  with  different  entries  in  the  E  to  obtain  c  A  . 


Thus,  defining 

cT(l)  s 

T_.iv 
c  E 

-1,  CT(2) 

=  cT(  l)En~2 , . 

T  T  1 

,  ...c  (n-1)  s  cA(n-2)EA 

we  have 

Ja1  = 

l 

( c  ^  * 

•  •  •  >  ’ 

c^i-l),  ..., 

Cn-l(1)>  cn)* 

Thereby, 

cT(l)  = 

””  cn-2 

’  Cn-ran’n-l 

Cn'  cn) 

cT(  2)  = 

(cl* 

**•*  Cn-3 

c  „-a  , 

,  n-2  n-l,n- 

-2  cn-l(1)'  cn-l(1)’  Cn) 

etc. 

For  Clausen's  example  we  obtain 


(4.7) 


and 


=V 

- 

c 

n 

-  er 

cTA  1 
n-1 

= 

cn-l(1> 

■  -r1 

cV\ 

n-2 

d 

= 

cn-2(2) 

■  r 

c 

H 

ii 

•H 

»H  _ 

'T  IlD 

*V 

= 

c.(n-i) 

-  (-i)n-‘i 

’*  =  h+ 

*n  V 

z* 

n- 

1  =  bn-l’ 

*S-2  *  bn 

_2»  etc.,  i.e.,  we  alternate 

b.  starting  from  b*  and  ending  with  b|  or  b^  according  as  n  is  odd  or 
even.  Since  Xj*  =  0  whenever  z.*  =  bj  ,  the  remaining  components  of  x*, 


21 


say  x*,  are  obtained  as 
x*  =  D_1d 

where  D  is  A  with  those  i**1  rows  and  columns  removed  for  which  x.*  =  0 
and  d  is  the  similar  contraction  of  the  b+  vector. 

The  new  device  we  have  employed  above  to  obtain  an  approximating 
(class  of)  interval  programming  problem(s)  for  which  we  have  instant 
solution  of  the  Minty-Klee  and  Clausen  examples  is  really  a  method  for 
obtaining  a  "good"  start  in  an  interval  programming  approach  to  solution 
of  linear  programming  problems.  Such  a  start  would  be  the  first  step 
in  using  an  interval  programming  algorithm  like  the  "knapsack  pivot" 
algorithm  of  Charnes,  F.  Granot  and  F.  Phillips  [  7  ]  or  the  SUBOPT 
algorithm  of  Ben-Israel  and  Robers  118  ] ,  or  the  "primal"  algorithm  of 
Charnes,  D.  Granot  and  F.  Granot  [6].  We  shall  develop  this  new 
method  in  other  publications. 

5.  COMPLEXITY,  POLYNOMIALITY  AND  COMPUTABILITY 

What  is  the  relationship  of  complexity  and  polynomiality  to 
computability  of  solutions?  The  Balinski  and  Gomory  polynomial  algorithm 
for  distribution  problems  was  never  used;  its  bound  on  number  of 
iterations  was  two  orders  of  magnitude  worse  than  common  computational 
experience  on  real  problems.  Their  12-iteration  example  [2  ]  was  solved 
immediately  by  the  VAM  "start"  (see  p.  58  [5]). 

An  essential  requirement  in  complexity  proofs  is  the  capacity  to 
argue  by  mathematical  induction.  To  achieve  this,  Balinski  and  Gomory 
discovered  a  separability  characteristic  in  the  distribution  model  constraint 
set.  They  were  unable  to  achieve  polynomiality  for  their  "mutual  primal- 
dual"  algorithm  for  general  linear  programming  because  of  the  lack  of 
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separability,  hence  inductibility .  Complexity  research  thus  focuses  attention 
only  on  algorithmic  forms  which  are  "inductible . " 

In  the  literature  there  seems  to  be  a  common  misapprehension 
that  complexity  (and  polynomiality)  is  an  efficient  research  directive  to 
better  methods  of  solving  "worst"  case  problems.  Yet,  as  A.  Vazsonyi 
observes,  for  over  a  century  the  most  efficient  method  of  computation 
of  various  functions  has  been  through  non-con vergent  (hence  a  priori 
"hyper-exponentially  complex")  asymptotic  series.  Of  course,  one  can 
then  change  the  definition  of  solution,  just  as  some  authors  have  redefined 
convergence  to  include  non-convergence. 

Again,  Gomory's  brilliant  finitely  convergent  integer  programming 
algorithms  frequently  converge  too  slowly  for  practical  use.  Often,  the 
evidently  exponential  "branch  and  bound"  method  is  employed  effectively. 
Focusing  on  polynomiality,  R.  Jeroslow  [14]  published  two  exponential 
examples  for  branch  and  bound.  No  information  regarding  structure  (e.g. , 
asymmetries  or  branch  exclusions)  such  as  is  accessible  where  "BAB"  is 
effectively  used  is  provided  for  these  examples.  Hence,  we  think,  no 
computer  specialist  would  ever  contemplate  use  of  BAB  for  such  problems. 
Incidentally,  both  examples  (for  all  n)  require  at  most  2  iterations  of  the 
"Page-Cut"  interval  programming  based  algorithm  of  Armstrong,  Charnes 
and  Phillips  [  1  ] . 

Typically,  complexity  research  ignores  important  characteristics  of 
real  computation.  Rather  than  "worst"  case  solution,  we  would  argue  that 
it  struggles  primarily  with  "imposed  problem  ignorance."  Khachian  deals 
with  Turing  machines,  not  computers.  Actual  operations  such  as  storage 
and  retrieval,  list  processing,  Gram-Schmidt  orthogonalizations,  updating 
and  control  of  round-off  error  are  dismissed  as  inconsequential  since  they 
are  polynomial  in  complexity. 


i.vW'* 
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But  polynomial  algorithms  such  as  Khachian's  can  be  totally 
impractical  for  computation  of  realistically  sized  problems.  Even  for 
small  examples,  N.Z.  Shor's  every  other  paper  mentions  the 
slowness  of  convergence  to  approximate  solutions.  The  world  largest 
routinely  solved  linear  programming  problem  (on  UNIVAC  1108's  by  the 
U.S.  Treasury  Department's  Computer  Group)  involves  50,000  constraints 
(excluding  non-negativity)  in  62.5  million  variables.  This  distribution 
(assignment)  model  is  solved  with  software  developed  by  Klingman, 

Glover,  Stutz,  Karney,  Barr  and  students  [  8]  over  nearly  ten  years 
of  systematic  experimentation  and  processing  innovation  exploring  the 
whole  spectrum  of  network  model  algorithms.  The  algorithm  is  the 
simplex  algorithm  in  [  5  ]  provided  with  a  good  start  (but  worse  than  VAM, 
which,  though  polynomial,  takes  too  much  time). 

Re  computability ,  clearly,  if  one  can  get  a  good  start  for  an 
adjacent  extreme  point  method,  it  doesn't  matter  how  many  extreme 
points  there  are  in  the  constraint  set.  Since  most  real  models  are 
compounds  of  already  identified  types  of  model  structures,  one  should  use 
such  knowledge  to  develop  classes  of  good  starts  via  simple  approximating 
structures.  One  might  try  approximate  solution  methods,  too,  when  the 
observed  structures  are  not  so  transparent.  Then,  if  exact  solution  is 
required,  one  could  "purify"  the  approximate  solutions  to  extreme  point 
solutions  by  methods  such  as  the  "Purification  Algorithm"  of  Charnes, 
Kortanek  and  Raike  [9],  [9a], 

Our  previous  demonstrations  have  indicated  the  power  of  interval 
programming  methods  for  obtaining  good  starts  as  well  as  their  promise 
for  efficient  solution  of  types  of  problems  which  do  not  fit  network 
structures  very  well.  Since  interval  programming  methods  like  the  "knapsack 


.-“♦•WSKH- 
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pivot"  algorithm  largely  employ  the  highly  developed  computer  processing 
software  modules  of  the  simplex  method,  we  suggest  computational  research 
in  interval  programming  is  likely  to  be  highly  productive. 

6.  CONSTRAINT  CONTRACTION  ALGORITHMS 

Since  the  work  of  Charnes,  Cooper  and  Drews  over  twenty  years 
ago  (see  Chapter  XVIII  £  6  of  [5  ],  especially  pp.  693-695),  little  research 
has  been  done  on  computation  of  LP  problems  via  the  inequality  system 
(TD).  Their  research  was  aborted  by  Drews'  leave  from  ESSO  to  complete 
his  Ph.D.  at  Berkeley.  The  current  work,  however,  features  ellipsoidal 
constraint  set  envelopments.  For,  Shor  and  associates  have  been  trying 
to  develop  algorithms  for  convex  non-differentiable  programs  which  employ 
analytic  function  approximants ,  of  which  the  simplest  are  quadratic. 
Ellipsoids,  however,  furnish  bad  approximations  to  polyhedral  constraint 
sets  in  n  dimensions.  This  may  substantially  increase  computation  time. 
For,  although  the  constraint  sets  here  are  mostly  a  single  (unknown) 
point,  the  bisection  process  involves  at  each  step  closest  envelopment  of 
a  partly  polyhedral  set. 

Our  idea  is  to  start  with  the  "smallest"  homothetic  expansion  of 
the  constraint  set  which  contains  our  initial  starting  point.  "Balls"  of 
size  2L  are  not  usually  required;  only  max  J b.  | .  Thereafter,  each  step 

-  i  i 

concludes  with  a  homothetic  contraction  and  a  new  starting  point.  We 
present  two  types  of  algorithms,  exterior  (reflection)  algorithms  and 
interior  (centering)  algorithms.  In  both  we  stop  when  a  sufficiently 
close  "solution"  (and  constraint  approximation)  has  been  reached. 

To  give  some  idea  of  relative  speeds,  the  following  examples  of 
inequality  systems  (not  even  LP)  have  been  computed  (by  hand). 
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Consider  the  system 


(6.1) 


22  -  1  S  xx  <  23  -  1 
22  -  1Sx2<24-  1 


or,  equivalently, 


(6.2) 


xt  <2-1 


-x1  <  -2“  +  1 


x2  <  2’  -  1 


-Vi-*  ♦ 1 


Here  L  =  19.  Khachian's  algorithm  requires  more  than  40  iterations, 
Gacs-Lovasz  more  than  18,  whereas  our  "curtailed  reflection"  algorithm 
requires  only  2,  from  the  same  start  of  (0,0). 

Replace  this  system  by  the  inconsistent  one 
x1  <  22  -  1 


(6.3) 


-xt  <  -2  +  1 


x2  -  2  -  1 


-x2  <-2  +  1 


Then  Khachian  requires  1146  and  Gacs-Lovasz  456  iterations  to  establish 
inconsistency . 

Evidently,  the  ellipsoidal  algorithms  would  greatly  benefit  if 
they  could  always  deal  with  an  equivalent  consistent  system.  We,  therefore, 
present  the  following  "regularization"  of  the  general  linear  programming 
system  (T)  according  to  the  precepts  and  results  of  Charnes  (1952)  in  [4  ]. 
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max  c  £  -  M^o 
S,t'  A5+bE  Sb 


(6.4) 


T, 
e  C 


<  U 


~  ® 


where  M  e  ||  c  ||-2L+1  ,  U  E  v/rT(2L+l) 


min  ri  b  +  n  U 
o 

T  T  T 

n  A  +  n  e  >  c 
o 

T.  >  -M 

n  b 


n.n0  *  0 


Both  primal  and  dual  constraint  sets  are  consistent  (£  =  0,  =  1;  n=  0, 

nQ  =  max  c.)  so  that  case  (iv)  of  the  Duality  States  theorem  holds. 

To  demonstrate  consistency  of  the  original  system  (T)  to  whatever 

degree  of  approximate  solution  is  desired,  one  need  merely  obtain  a 

member  of  the  (TD)  constraint  set  with  ESI.  We  thus  define  a 

o 

"Curtailed  Solution  of  Degree  (a, 6)"  to  be  a  member  of  the  constraint 
set  of  the  new  (Td)  wherein  the  coefficients  in  (T)  have  been  curtailed 

_ (V  Q 

to  precision  of  2  and  magnitude  of  2r  We  suggest  that  this  notion  of 
solution  may  be  useful  in  matters  of  approximate  solution. 


Exterior  (Reflection)  Algorithms 

The  reflection  of  a  point  on  the  "wrong"  side  of  a  constraining 

hyperplane  to  the  "right"  side  of  it  yields  a  point  at  lesser  distance  to  the 

constraint  set  (see  Chapter  XVIII  of  [  5  ]).  The  amount  of  distance 

reduction  depends  chiefly  on  the  "thickness"  (diameter)  of  the  set  and 

o 

the  pre -reflection  distance  to  it.  In  our  C  (constraint  contraction) 

algorithms  a  balance  is  sought  between  rapid  contraction  of  set  size  and 

maintenance  of  closeness  to  the  constraint  set. 

T  T 

When  the  vectors  a  .  in  (1.2)  are  taken  so  that  a  .a.  =  1,  |  0^(x)  | 
is  the  distance  from  x  to  the  i**1  hyperplane.  Addition  of  the  same 
constant  to  all  b.  results  in  an  expansion  or  contraction  of  the  constraint 

£ 
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set  so  that  the  distance  from  the  center  of  the  set  (e.g.,  the  generally 
unique  member  of  (TD) ,  see  figure  1)  to  each  hyperplane  is  changed 
by  the  same  amount  for  all  hyperplanes,  i.e.,  it  generates  a  homothetic 
transformation  of  the  set  about  the  center. 

Each  algorithm  generates  a  sequence  of  points  x°,  x*,  x^,..., 

k  lk 

x  ....  and  a  sequence  of  right  hand  sides  b,  b  . b  ....  where 

bk  =  b  +  eAk,  where  |A^|->-0.  The  point  xk  satisfies 

T  k  k- 1 

(6.5)  a.A  xK  ^  bK  ,  i=l,  ...  n 

t  Ir  Jr 

and  A  (hence  b  )  is  chosen  so  that  x  is  outside  the  constraint  set  of 
T  k 

(6.6)  a  x  <  b 

We  stop  at  xN  when  |AN|  is  sufficiently  small. 

The  constraint  contraction  process  proceeds  as  follows.  Start 

with  some  x°.  If  x°  satisfies  (1.2),  stop.  If  not,  choose  A°  so  that 

max  (a'*'.  x°  -  b.  -  A°)  =  0,  i.e.,  A°  =  max  (a^.  x°  -  b.).  Set  A1  =  f  A°. 
ill  j  i  i  4 

O  T  k 

Then,  x  is  outside  (x:a  x  <  b' },  Recursively,  having  obtained  xK 

within  {  x:aT  x  <  bk  }  ,  then  m^x  (a^.xk  -  b.)  =  PkAk,  where 

i  i  1 

0  <  pk  <  1.  Choose  Ak+*  =  1  pkAk.  Then  xkis  outside  {x:a^x  5  bk+1} 

k+1 

we  apply  our  chosen  reflection  procedure  to  get  x  within  the  latter  set. 

The  simplest  procedure  reflects  in  the  most  violated  (variant  :any 

.  T 

violated)  hyperplane,  i.e.,  the  hyperplane  with  normal  ar  where 

a^  xk  -  bk  =  max  (a^  xk  -  bk).  Next  set  vk^  =-a^,  an<*  ^(k)  =  xk  +  oijVk, 

where  a  is  chosen  so  that  a^z1  (k)  -  bk  =  -(aT  xk  -  bk  ).  Thereby 

a,  =  -2(aT  xk  -  bk  ) 
l  r  r 

i 

1 


(6.7) 
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If  z\k)  is  in  the  "k*b  set"  {x:a^x  <  bk),  set  z*(k)  =  xk+*. 
If  not,  reflect  z!(k)  to  obtain  z2(k),  etc.  until  some  zm(k)  is  in 
and  then  set  zm(k)  =  xk+*. 


To  get  into  the  k*b  set  more  rapidly,  one  might  use  "curtailed" 

reflection  or  "guided"  reflection.  In  curtailed  reflection  one  proceeds 

no  farther  than  the  most  distant  un- violated  hyperplane  s  such  that 
T 

a  a  <0.  I.e.,  one  takes  s  so  that 

s  r 


(6.8) 


bk  -  aT  xk  =  max  (bk.  -  aT.  xk) 

S  s  .+  11 

r 

where  I*  =  (i:bk  -  a^\  xk  >0  and  a^  ap  <  0  } 


For  z^k)  not  to  violate  s,  one  must  have 
bks  -  as 

(6.9)  a  <  -Ap - 5 - 

-a  a 
s  r 

Thereby  is  chosen  as  min 

lr 

In  guided  reflection  one  reflects  x  in  hyperplane  r ,  but  moves 
T 

m  the  direction  of  a  .  Thus 

s 


-2<aTr  xk  -  bk  ), 


bk  -  aTR  xk 
s  s 


T 

-a  a„ 
s  r 


%(xk  +  Vs)  -  bKr  = 


(aTr  xk  -  bk) 


so 


(6.10) 


al  = 


-2(aTr  xk  -  bk) 
T 

a  _  a 
r  s 


^  V 


t 
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Interior  (Centering)  Algorithms 

In  our  interior  "centering"  algorithms  we  start  each  iteration, 
say  k,  with  a  point  xk  on  the  boundary  of  the  kth  set  {x:aTx<  bk  }  . 
We  attempt  to  move  to  the  center  of  the  constraint  set  by  moving  out 

V  t 

from  the  boundary  in  a  direction  v  ,  to  be  defined.  Thus,  we  consider 
1^  1^ 

z  =  x  +  av  and  try  to  find  a  best  (reasonably  computable)  value 
for  a.  For  the  kth  set  (and  bk)  we  define  d^(x)  =  -  e^x).  Thus, 

(6.11)  d.(zk)  =  b.k  -  aT.  (xk  +  avk)  =  d.(xk)  -aaT.  vk 


Define 


1°  =  { i:d.(xk)  =  0}  , 


V*  H  (i:aT.vk  >  0,  V  ={i:aT.  vk  <  0} 

1C  X  K  1 


k  th 

In  order  that  z  remain  within  the  k  set,  we  must  have 
d.(zk)  >  0.  By  (6.11),  this  is  true  iff  aa^vk  <  d.(xk).  Letting  r 


be  such  that  i 


k  T  k 

We  must  have  0  <  a  <  d  (x  )  la  „  v  .  To  "center"  as  well  as 

-  r  r 

possible  we  want  to  choose  a  in  this  interval  so  that  we 


(6.15) 


max  min  d.(z  ) 
a  i  1 


Let  8  e  I,  be  such  that 


(6.16) 


T  k  .  T  k  Ui 
-agv  <  -a.  v  ,  yi  e  Ir 


Then  s  corresponds  to  the  line  of  minimum  slope  from  the  set  I 
in  the  following  plot: 


Evidently,  it  would  be  fairly  complicated  to  exactly  choose  a 

Jr 

to  max  min  dj(z  ),  e.g. ,  Q .  Thus,  we  choose 

(6.18)  a  =  a  =  dp(xk)/(|ap  vk|  +  |  aTg  vk|  ) 
or,  even  more  simply,  if  desired, 

(6.19)  a=  a  =  i  d  (xk)/aT  vk 

4  r  r 

k+1  k  k+1 

Then,  x  =  z  and  we  choose  A  as  the  minimum  A>  0  such 

k  k  ir 

that  dj'(z  )  >  0,  where  dj'(z  )  means  we  use  not  b.,  but  bj  +  A.  The 
iteration  is  complete  in  taking  bk+1  =  b.  +  Ak+1. 
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CONCLUSION 

In  the  foregoing,  we  have  attempted  to  show  through  key 
examples  in  the  context  of  Khachian's  and  related  work  the  in¬ 
appropriateness  and  misguided  character  of  "complexity"  as  a  guide 
to  worthwhile  directions  of  research  in  computability  of  mathematical 
programming  (especially  LP)  systems.  We  have  tried  to  indicate 
better  directions  and  have  suggested  explicitly  methods  which  might 
improve  computation  in  both  approximate  and  exact  solution.  Let  us  conclude  with 
two  further  examples  of  "computability"  versus  "complexity"  approaches. 

First,  L.E.  Woolsey  observed  that  he  always  got  extremely 
large  times  for  geometric  programming  calculations  whenever  constraints 
were  slack  in  the  final  solution.  He,  therefore,  added  additional 
variables  and  a  corresponding  small  perturbation  of  the  functional  to 
insure  that  all  constraints  were  satisfied  as  equalities.  Result:  great 
improvement  in  comoutational  speed.  Further  result:  R.J.  Duffin 
and  associates  developed  new ,  simpler  proofs  of  geometric  programming 
theory  using  the  Woolsey  perturbation  and  ordinary  Lagrangean  theory . 

Finally,  in  the  earliest  days  of  linear  programming  computation 
oil  company  computer  groups  observed  that  they  got  excessive  times 
in  general  LP  calculations  whenever  there  were  zeros  in  the  right  hand 
side  vector.  Computability  solution:  Introduce  a  new  variable  and  equation 
constraint,  xn+J  =  1  and  add  multiples  of  it  to  the  constraints  with 
zeros  to  knock  them  out.  Result:  great  improvement  in  computation 
time.  Although  this  device  is  part  of  the  folklore,  many  newcomers 
to  computation  are  still  unaware  of  it. 

Oddly,  there  is  a  historical  perspective  for  it.  Gauss,  in  trying 
to  improve  computation  of  the  usually  (we  would  call)  ill-conditioned 


imAi.  < 


systems  of  linear  equations  involved  in  geodetic  or  magnetic  problems, 
introduced  an  additional  variable  and  equation  which  would  increase 
the  value  of  the  determinant  (hence  the  condition  of  the  system)  over 
that  of  the  old  system.  This  helped.  Gauss  apparently  hit  upon  such 
a  device  since  he  himself  performed  actual  computation. 
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